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ABSTRACT 

•This art 
evaluated course offered 
Extension, The purpose o 
elementary classrooms th 
materials (Winicourses) 
Research and Development 
I, Effective Questioning 
the questioning and disc 
grade teachers. Each ins 
(a) the teacher reading 
instructional film and c 
viewing a model lesson f 
recording these on a for 
and conducting a 10-minu 
pupils from her own clas 
♦•vice) ; and (e) the teac 
lessor, with a colleague, 
undertaken by a comparis 
of discussions made in t 



icle describes a jointly planned and jointly 
through Washington State University General 
f the course was to improve instruction in 
rough use of competency-based training 
from the Far West Laboratory for Educational 
. The Minicourse used, entitled "Minicourse 
: Elementary Level," was designed to improve 
ussion skills of primary and intermediate 
tructional lesson consisted of the following: 
handbook material; (b) the teacher viewing 
ompleting handbooK quiz; (c) the teacher 
ilm, identifying target behaviors, and 
m in the handbook; (d) the teacher preparing 
te microteaching lesson with a small group of 
s (this is video recorded and replayed 
her reviewing the third replay of the reteach 

^'valuation of the Minicourse program was 
on of pre- and post-course audio recordings 
he teachers' own classrooms. (JA) 
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r>*atc •University havo Jfilntly oxnorlmantiid with 

tho use of vnrlous c'^c^nco stmterrles to 

frtclflt.^tn Innovation In tha schools. Tar Mar 

n'^r.u?tn thos<^ coon^r^+tvn of forts am 

,^'*nrr!^f^i^ ^l^^^wh'^r*^, (t) Thr> nur'^os^ of t*>ls 

^r^IcJ-^ In to doncrtbo n loln^lv nlannt^cJ and 

r:>!n>h' ^vr^lua^^'f ccur^^ r^fforo-j thrru'^^ tho 

vri? '^i^nf^r-*! ^yt^nslop, Th<» rour«^^ and tha 

nvihi^^l'^i pror<r»durnr5 wore* ron^luc^f^d with tha 

?»'-.sl'>t«no> rf rrjin* u'^d'^r Titfn III (Tvst^natlc 

'^rricrn*^ for Instruction?) I If provcn^nt) of tho 

•^•*?nt«>rv ?»nd Second/^rv ''duc^tlon of I9^*>, 

T^/^ purnoso nf tho ccurs<* was tc Irinrove 

■ 

?n<^trur'+lor In ^ jn^-v^nt.m/ cl ^"j^roo*^ through 
u^? rf crknf^nt<=>ncv-b*?r>od trnlnfno '••tprlal^ 
CMnfcr^iTr'^'i) fror the \'^<;t L^*^or«torv for 

"'u'^at f '^n t ^r*c;»Mrr*^ n'^d '^f*v'*looront» C^) 
'^f th'- vi^rlou*"* 'Mnlcrursps r^v^^l L^hl**, ona 
itcr.-^r^ ^w^n? f f^rtltfod -Mnlcourt?*** i , ^^f f '>^]tl ya 
'^ti'^stfor In^ ! ri<>npntnrv L^vol . It wn<i d^slonad 
tr f-^pr^V'-^ tho nur^itlonlrr nvid Jf ';cu*">3f on 
^>^'I I I r- ■'^^ •"rf'^r^rv •'^nd I ntr»rr^dl "^^o ^ocichars. 
'''*»p ■'^ ^^'^'o*' W ^ !•■*"* r'^u^ f T'^s-'^'* pi^^ ^ {^f^ V ' to*^ • 

^^"^ ^ .^r^ ■*'tn'^ ^*l^f 'TOti r*^ '^'^ ^' *i ."^ 

J ' .'^ jf n * > \ * ' p I i*^ r ' ^ < * r ^ ( *^ 1 ' y 



<4) nn <iio*)»nt of Mtnt course which sorvad as 
the toxtbook for tho WSLL.coursn . The ob,!«ctlv«s 
of th« Mini course (Teblo I) wore used to derive 
the objectives of the WSU course. These objec- 
ttvof. w«r«> further anntyzed Into component 
'jehevltsr'*. fhlch bocamo th© i^rfY\\ per fonnanco 
<it»ndards for the course. The MInlcourso Intro- 
ductory losson and four Instructional lessons 
reaulrod about 75-90 minutes on each of fifteen 
school days distributed over the several weeks 
of the WSU course. Each Instructional lesson 
consisted of tho followlna activities: 

I. Tho toachor reads the Hjmdbjoj^^ 

which presents the backt^rcTund research 
and the rationale for the ♦arqet behaviors 
of that lesson. 

7. nther alone or with the class, the teacher 
vUws th^ Instructional film and completes 
' a nufr coverinq the ^tendlbock and film 
material . 

Mnxt, the teacher views a model lesson on 
film, Identifies tarqet behaviors and 
records these on a form provided In the 
^l^Jl4.^.2J^« Identifications are verified 
Of corrected durinq a rep lav of the same 
model seouence. 

Thft teacher prepares and conducts a ten 
nlnute mlcroteachlno lesson with a small 
qrouD of pupils from her own cUss. This 
Is video recorded and th'^n re'^My^d twice 
foflowinq Instructions in the Handbook, 




TABLE I 

Mtntcoursa 1 Objectives and Skills 



INSTRUCTIONAL SEOUnNCEvJ 
Objective 




Skills Covered 



^^ancje teecher behavior (teaching techniques 
'and practices) In order to Increase pupil 
readiness to respond to discussion ques- 
tions. 

Asking question, pauslnt; three to five seconds, 

then catling on pupil. 
Dealing with Incorrect answers In an accepting, 

nonpunltlve manner. 
Calling on both volunteers and nonvolunteers 

In order to keep all pupils alert and to 

distribute participation. 



INSTRUCTIONAL SEQUENCE 2 



Objective 



Skll Is Covered 



To Improve teacher skills so as to decrease the 
amount of teacher participation and Increase 
the amount of pup 1 1 participation. 

Rod I root I ng the same question to several pupils. 

Framing questions that call for longer pupil 
responses. 

1. Asking for sets or groups of related facts 

when formulating Information- 1 eve I questions, 

2, Avoiding Yes or No replies. 

Framing questions that require the pupil to use 
higher cognitive processes. 



INSTRUCTIONAL SECHJENCE 3 



Objective 



Skll Is Covered 



To Increase teacher use of probing techniques In 
order to guide tho pupil to more complete 
and thoughtful responses. 

Prompting. 

Seeking further clarification and pupil Insight. 
r*»..focuslng the puDll's rrsponse. 



INSTRUCTIONAL SEQUENCE 4 



Objective 

Ski I Is Covered 



To reduce teacher behavior that Interferes with the 

flow of the discussion. 
Obsorvlnn the following rules: 

1. Teacher should net repeat his own giJ«?tlons. 

2. Teacher should not answer his cwr cuestlons. 

3. Teacher should not repeat pupil answers. 



9. It Is suggested that th« third r«p lay of 
tho mttach lasson b« rovlewtd with a 
ooMaagua. This stap was e&nsldared 
optional, but was complatad by many 
participants. 

In brief, each lesson consisted of a three^ 

I phase sequence: Instruction, practice, and 

feedback. 

Initially, Walla Walla central office 
personnel conducted a general session on the 
MInloourse at each participating elerwntary 
school. This session provldod Information to 
hnip teachers decide whether to slcjn up for 
the coume and to begin tho orientation of 
those who would enroll. The film Introduction 
to the course provided an overview of the 
objectives and approi.ch of the course. A total 
of 45 teachers from four elementary schools 
wem enrolled In the two sections of the course. 
All participants were reglstored for one 
semester credit. The courso was taught by a 
regular faculty rwinber of the WSJ Departinent of 
Education. 

General sessions wwre conducted In each 
school to provide toachers background Informa- 
tion on questioning strateqUs find on the 
Mfnfcourse. Instructional and niodal lesson 
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ftlflis W9r« available on ftchadule at each partlcl- 
patinq school. Teachers viewed these either 
Individually or In groups. MIcroteaehIng was 
conducted wo^t satisfactorily In a room where 
Goulpment could remain sot up and ready fpr 
operation. Each participant planned the nlcro- 

I 

teach s«»s«iton and conducted It with hfs or her 
own pupils, who, by the way, were general I y very 
will Inn to participate*. 

The Instructor conducted th<» fi*»neral 
sessions and made phono contact with the schools 
periodically to answer any questions which arose. 
Generally, the se<?uence of activities for the 
winlcourse procn^dad as pfnnnod and there war© 
few nudstlonSe •^fnor difficulties ware encountered 
In following fhf^ s^ctfrins of the t^andbppk and 
In the mechanics of schf^dultnr? moms, equipment, 
materials end pupils. The course concluded 
with a qeneral session and evaluation, 

Ey^ \ uat Ion of Course Part I c Ipants ^ P erf or manco 

Research studies of the Far West Laboratories 
have e^Jtabllshed that when teachers follow the 
orescrlbod Instructional sequence, the tarqot 
bohavlors are attained at a sattsfnctory level, 
and the^e are retained over a considerable period 



of time w'lthout appraclabte loss (5). Oecause 
of this pasearch evidence, major evaluation of 
the course work of Individual participants was 
based upon a record of the completion of the 
prescribed sequence of actlvlt!es. Scheduling 
charts of the cornponent activities, certification 
of completion bv the bulldlnq principal and sub- 
mission of the completed Handbook were used as 
evidence of completion of the course. All but 
two of the 45 reqlstrants completed the course. 
Individual accomplishments were discussed with 
the Instructor during the final class session, 
and all participants completed a form evaluatinq 
their own qrowth and their attitude toward the 
experience. 

F.va I u»tJon_qf tho ^Jj^JSP^S^'^ ^mrir?n^ 

PuTte apart from courso qrados, an evniua- 
tfon was nad« of thi effect lvf»npss of the wtnl~ 
course nrofjran. This n^^ase of tho ovafuatfon 
wn«? und«»rtnken hy ronnar son o* pre- and 
oost-course auHIo record Inns of dIncuGGfons 
ined«^ In the tenchnrs* own clnssroors. The 
>ir>\\rt WaMa District stc^ff nqroftd to arri^noe for 
and obtain record fncs from n random sample of 
teachers «xpresslnc an lnter«»j;t In the course. 



A totiil of 94 pre-ttpas and pott-tapes wore ^ 
obtained; these were coded and scrambled In the 
Walla Walla District before being sent to 
Washlnoton State University for soort nq. 
Scorers on the campus had no knowledpe of 
names of teachers, schools, or Whether tapes 
were pre- or post-co'jrse samples. Procedures ' 
for scorinc} the tapes were patterned after 
those used at the Far Wast laboratory. 
Instructions for scorlnn were obtained frbm 
the Lehorntory, alonq with transcripts of 
classroom discussions from their files. 
These scripts were scored by the course 
Instructor lor occurrence of specific teacher 
skills covered In MInlcourse I and were returned 
to the Laboratory for check I nq. In this way, 
scorlnq procedures at Washlnpton State Univer- 
sity wer** standardized with those at the 
Laboratory. A te?iw of scorers at Washington 
State University was trained until they 
reached an acceotahle level of Interrater 
renahlllty. 

In the process of scoring the 54 tapes. 
It was discovered +hat a numbor of ty^p'^s had 

to he eliminated becau'jo of Inadenuate tf»nnth, 

■A 

poor rocordlnn nualltv or other nonstandard 
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eondtttonf. The data roported here are based 
on a set of matched pre- and post-tapes for 
thirteen of the forty-three teachers who COW" 
pleted the course* Hach tape was scored for 
occurrence of nine behaviors which were expected 
to chanqe as a result of teacher participation 
In Mtnlcourse I . 

^f^l}^^y^^.^J?T^^I\f^}y^^KPX J^SJiZ fPA Post-Course 
Tapes 

Results of tha analysts of ore* and post- 
course tapes are presented In Table 2. Partici- 
pants made the expected chances In their behavior 
on all but one of the nine fneasures* To pro- 
vide an added dimension for evaluation^ results 
from one of the Far West Laboratory field tests 
<6) are also presented In the Table. Direct 
comnerlson can he made on four measures: 
perrentaqe of teacher talk, lennth of pupil 
response, number of one word pupil responses, 
and percentane of questions that call for 
hlqher coqnitlve oupll responses* J^asures 
stated In terms of the ''number of times" a 
hehnvlor occurred are not directly comnarahle 
because of b ffvo minute difference In loncth 
of thp standard tane nample. Nevorthofess, 
In«;nectIon ^ows chanoes In the same direction 
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TABLE 2 

Comperl$<ift of Pr«- and PoBt'>Mlnlooursi» Tapes 



Behavior Compared 



Far West Laboratory 
Walla Walla Teachers Field Test Teachers 

Pi «-tape ^st~tape Pro-tape Post-tape 
Mean ^an Moan Mean 



1. Percenta<?e of discussion 
tifne taken by teacher talk 

2. Number of times teaehor 
used r««dIrectlon 

3. Number of times teacher used 
probing 

4. Number of tlrnos t«n=:;hor 
repeated own questions 

fj. Number of times teacher 
repeated pupil answers 

6. Number of times tfiJichor 
answered own 'questions 

7. Len?|th of pupil responses 
In words (besod on flv8- 
wlnufe samples of p ro- 
und post-tapQs) ^ 

8. Number of one word pupil 
rosponsas (based on five- 
minute samples of pro- nnd 
post-tspes) 



Percentage of tote! /^uftstlons 43,3 
cslllng for hlqhr»r cognitive 
pupfl responses 



43,8 
24.7 

6.7 
.3 

4.1 
• U3 
11.^ 



IS. 



2A,Q 



6.3 



.1 



l.n 



I3.n 



5.1 



55.3 • 



51.6 



2G.7 



8.3» 



13.7 



30.7 



4.6 



5.6 



5.8 



37.3 



27.8 
40.9 
I3.9» 
4.7 
4.4 
.7 
11.8 



2.6 



52.0 



linless otherwise noted, thf) WoMa Walla data aro bsRod on class discussions 
aporoxtmately 15 minutes In lonnth; the Far Wast Laboratory data are based on 
twenty-minute discussions. 

•Represents a totnl of "promptlnq and furf^^tr cUrlf tcatlon" In Far West Labora 
tory data. 



«nd of stmt l»r maqnttudA as thota In the Fer 
West Laboratory field tost.. 

It If evident that the entry level perfor- 
mance of Walla Walla teachers was farther In 
the deslrad direction on- all of the nteasures 
rhnt are directly conparablot except the number 
of one word PcsponRes In a 5 minutes sample* 
It Is possible that this hlqher entry/lovel was 
due to previous change of forts mentioned above. 
At any rate, gains had to be registered from 
o nora advanced Initial level. Novortheloss, 
Walla Walla post-tane scores exc<»odod the 
Laboratof"Y*8 field test scores on all directly 
coTjparabIa scores but tho number of one word 
responses. One explanation of these differences 
Is t^at the Wallfi Walla teachers used tne 
final, f>ollr>hed version of VInlcourse I, whereas 
thn Far Wost Laboratory teachors used an early 
developmental version, 

A brlaf oxamln.it Ion of each of the nine 
measures affords some additional appraisal of 
teachers' attelnmont of the course objectives. 
I. P«rf:«nt«ic5fi of discussion time taken by 
t«achar talk showed the larqcst porcentaqe <?aln. 
This measure Is perhaps tho singlo tnost signifi- 
cant one since It reflects the results of many 



of tfwi courM objectives which ere Intended to 
qlve "elp tlwe" to pupil* rather than the 
teacher. The post-tape score Is sllqhtly 
better than that of the F«r West laboratory 
sampie. 

2. Redirection occurs wh^n n teacher calls 
upon different pupils to respond to the same 
quostlon. If the teacher asks e nuestlon, a 
PUD 1 1 responds, and then the teacher redirects 
the seme question to three other pupils, this 
Is scored as three occurrences of redirection. 
Redirection allows pupils to "carry the hall" 
In discussion. It Is a technique which comes 
throuph clearly In the Mini course l*9SSons. The 
Increase In the use of this technique was 
approximately the same for Walla Walla as the 
Laboratory sample, althouq»> th© total ncor^s 
wore iowor. 

3. On« dIff«renco In aooronch to the scoring 
of the Walla Walla tenes wes that Instances of 
promptlnn and nskinc for further clarification 
were talllfld tooether as "nroblno." The reason 
for cofpblnfnn th«m Is tH«t both assess tho 
oxtont to wMch teacher nuostlons pursue more 
complfttft answers from nuolls. Prohlnn occurs 
when thrt teacher asks a question, tho student 



.responds, and then th© t«8chep asks tha same 
studont another question (the "probe") to elicit 
ti noro comolete, thoughtful response. This 
was the only moesur** which did not show movo- 
rwnt In the dlrnctlnn of course ftoals. This 
ohjrctlvp nay be one for which some addltlonni 
f o 1 1 ow- up wou I d be 0 roduct I ve . The Coordinators 
HejmiJi^'Vik for the Mini course contains sungestlons 
for such A pronram. 

4, 5t f:. The so-called '*nonatIve behaviors," 
vhlch tend to Increas'i teacher domination of 
dlscu^sl'^n tlin3, occurred at a low level In the 
pre~tap«s, Fv^n though reductions of these 
practices were small, the very low scores of 
Walla w.iHa toachars are quite In harmony with 
courso objectives. It Is worth noting that 
the comnon trait of repeating a pun! I answer 
was nducod to ono- fourth of Its prt^-course 

7, T!v^ janqth of nuofl rospon«« and the 
nuRber of ono word sns^^ars nre morisuros which 
rnfloct nost directly the pupj J. growth resulting 
frn-^ thn co^iV'-.c. Tha "lny6'?Ttirs-^ r-^connlzes 
that part of the train I nd of teachers Is the 
tralnlnn of pupils to rrfspond to the new teacher 
hohavlnrs. Whnn answers aro lon(;or pupl's 
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are llktfy to be qrappUno wffh stfinff leant 
probloms at hlqher levels of Bloom* s taxonomy 
of coqnitlve objectives (7). Predicted 
chanqos did occur In thdse measures. 
9, Percentage of hlf^her cognitive questions 
was nreater for the Walla Walla sample than 
for the Laboratory sample on both the pre-tape 
and nost-tano. It U difficult to analyze 
fust what Influences were at work here. Per- 
haps previous district proqrams are reflected. 
It Is gratlfyfnq to recoj^nlze the potentiality 
this measure may Inply for the quality of 
discussion In the classrooms of these pnrtlcl- 
pants. 

I 

Trftchrjr Tflsoons^ to Mlnlcour*;^ I «s 
rf>ff^cto4 !n +Hr» concludlnrj qupsttonnnl rp, was 
ovorv^helnlnnlv fnvorabtn. '!!n<^ty •«50von per- 
cent of th« fnrtv rf>snond«nt^ constdorid ft 
ftTth^r «n '^'^xca! f^pt*' (^01) or "rood'' (37.')Jf) 
^x^f^rtnncf^. Tbf>v consldororj tho most vnlu^ible 
ff*»rr!nn^^ to th<* ♦;'^! f-nvn!u?jt (nn^corrf^ct Ion 
afforded by the nicrotoachinn and thr» pr^otlco 
of quosttonfn^ f;tr^tAqf<^r,^ ^^orty-two oercont 
of tho rr»spond'^ntf; ronortnd usfnn all of the 



«ktlls tn thftlr elassroewn at tha eoneluston 
of the coursa. Sevonty-thrao parcent poportad 
that thov noticed chanqes tn pupil behavior 
which thny could attrlhuto to the Mfnlcoursa. 
Furthormoro, the teachers considered the course 
nf>ro valuable than thoir previous Insrrvlco 
tralntnp <??3'J), extension course** (7'5'^)» or 
on-cawpus oducatlon coursis (7^*^). Seventy- 
three oercent rnrxyrfod that they would be 
Interested In oartlcloetlno In other such 
MInlcoursos. Another twenty percent would 
participate under certain altered conditions, 
for example. If the course were offered 
earlier In the year. Such endorsement Indi- 
cates that this particular use of the Far West 
Laboratory *Mn I course was address Inn skills 
teachers felt to be Important. 



In sufnmarv, th« preoondamnce of !nd!- 
cat ton*; Is tn^it fh^ usft of tho Far Wost 
Laborotorv nfcourso, ETf foctWn Cunfst lontnj]^: 
F.l ewnt/irv Lftvei |n the Wash I nptnn St;^to 
University Heneral Extension cla<;n did In 
fact contrlhuto slant f leant I y to thn Innrovo- 
mont of thn tnchntou^s nosod ns objnctfvos 
for fhn coursa. ^>or«nwhat l^ss dlrf^otlv, and 
by Imnllcatlon, It contrlNutod to th^ norfor- 



manes of #lsm«nt«rv pupils In thosa classrooms, 
A co«p#tsnev-basa<l aporoach to Insarvtca 
tralninn was found to Nci affacttvo In skills 

which can bo Idontlfloc!, modeled, and practiced 
with appropriate fnadback* "^toroover, this 
approach Wtis hfnhly accoptahfo to teachers 
undor the conditions of this course* Havinn 
Instructional materials readily available ^nd 
boinn abia to practice skills In the school 
with one% own pupils wert evidently factors 
which enabled a sirjn If leant pr>rcentane of each 
bulldinn faculty to participate. Rarely does 
an Inservlce pronran receive such enthusiastic 
response. 

The course also Identified new approaches 
for university - school district cooperation. 
The careful development and research behind 
these naterlals enahles a hlqh level of mastery 
of the objectives for a course with a rlnlmum 
of Involvenent of campus personnel. At a 
time of qrowlnq Interest In f loM-based Instruc- 
tion, such ^■lnlcourses offer a new possIbHlty 
for off-canpus Instruction. 



